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DESCRIPTION 
VEHICLE SURROUNDING DISPLAY DEVICE 

TECHNICAL FIELD 

[0001] The present invention relates to a vehicle surrounding 

display device, and more particularly to a vehicle surrounding 
display device which selectively displays at least two types of 
images in the vicinity of a vehicle, and informs a driver of a 
positional relationship between the vehicle and an obstacle. 



BACKGROUND ART 

[0002] Conventionally, a vehicle surrounding display device 

as described above (hereinafter, referred to as a conventional 
display device) includes a plurality of imaging devices, a 

15 plurality of laser range finders, a solid virtual section, an image 
converting section, and an image display section. 
[0003] The plurality of imaging devices are mounted on a 

vehicle 1 and these imaging devices image an environment in the 
vicinity of the vehicle 1. The plurality of laser range finders 

20 measure distances to objects within view fields (subjects of the 
imaging device) from the laser range finders. One imaging device 
and one laser range finder are disposed in the vicinity of each 
other . 

[0004] The solid virtual section is operable to obtain a 

25 distance image (see an upper left image of FIG. 18) within the 
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view field based on distance information from the laser range finder, 
and to recognize objects within the view field based on an original 
image (see an upper right image of FIG. 18) imaged by the 
aforementioned imaging device. Based on the two pieces of image 
5 information which are the original image and the distance image, 
and the information about the recognized objects, a 
three-dimensional field of view is reproduced by simulating an 
invisible portion of the objects, which cannot be captured by the 
imaging device. 

10 [0005] The three-dimensional information reproduced by 

solid virtual means is sent to the image converting section. As 
shown in a lower image of FIG. 18, based on the received 
three-dimensional information, the image converting section 
generates a bird' s eye view which appears to be imaged by a virtual 

15 camera which is set to be virtually mounted above the vehicle. 
The bird's eye view represents a view of the vehicle and its 
surroundings seen from an appropriate viewpoint at the side of 
the vehicle, and is displayed by the image display section. 
[0006] Alternatively, viewpoints for the bird' s eye view are 

20 set at two points diagonal to the upper right and the upper left 
of the vehicle, respectively. The bird's eye view imaged from 
either viewpoint is selectively displayed. In this case, the 
viewpoints for the bird' s eye view are switched to each other in 
accordance with a steering angle of the vehicle. 

25 [Patent document 1] Japanese Laid-Open Patent 
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DISCLOSURE OF THE INVENTION 
PROBLEMS TO BE SOLVED BY THE INVENTION 
5 [0007] As described above, the conventional display device 

displays a bird' s eye view seen from a virtual camera which is 
set to be virtually mounted above a vehicle. Therefore, when the 
vehicle comes in close proximity to an obstacle, the obstacle will 
enter a dead zone generated by the vehicle, whereby there has been 
10 a problem that a driver has a difficulty in visually recognizing 
the obstacle. 

[0008] Thus, an object of the present invention is to provide 

a vehicle surrounding display device capable of displaying images 
such that a driver can visually recognize an obstacle more easily. 

15 

SOLUTION TO THE PROBLEMS 

[0009] To achieve the above objects, a first aspect of the 

present invention is directed to a vehicle surrounding display 
device which selectively displays at least two types of images 

20 in a vicinity of a vehicle . The vehicle surrounding display device 
comprises a measurement section for measuring a distance and a 
direction from the vehicle to an obstacle in the vicinity of the 
vehicle; a comparison section for comparing the distance measured 
by the measurement section with a predetermined threshold value; 

25 a viewpoint determination section for determining a predetermined 



first viewpoint when a comparison result generated by the 
comparison section indicates that the measured distance is larger 
than the threshold value, and for determining a second viewpoint 
based on the direction measured by the measurement section when 
5 the comparison result generatedby the comparison section indicates 
that the measured distance is not larger than the threshold value; 
an image generating section for generating, when receiving the 
first viewpoint from the viewpoint determination section, a first 
image representing a view in the vicinity of the vehicle as seen 

10 from the received first viewpoint, and for generating, when 
receiving the second viewpoint from the viewpoint determination 
section, a second image representing a view of the vehicle and 
the obstacle as seen from an area in the vicinity of the received 
second viewpoint; and a display section for displaying one of the 

15 first image and the second image generated by the image generating 
section . 

[0010] A second aspect of the present invention is directed 

to a vehicle surrounding display method for causing a display device 
to selectively display at least two types of images in a vicinity 

20 of a vehicle. The vehicle surrounding display method comprises 
a measurement step of measuring a distance and a direction from 
the vehicle to an obstacle in the vicinity of the vehicle; a 
comparison step of comparing the distance measured by the 
measurement section with a predetermined threshold value; a first 

25 viewpoint determination step of determining a predetermined first 



viewpoint when a result received from the comparison step indicates 
that the measured distance is larger than the threshold value; 
a first image generating step of generating a first image 
representing a view in the vicinity of the vehicle as seen from 
5 the first viewpoint determinedby the first viewpoint determination 
step; a first display step of displaying the first image generated 
by the first image generating step; a second viewpoint 
determination step of determining a second viewpoint based on the 
distance measured by the measurement step when a result received 

10 from the comparison step indicates that the measured distance is 
not larger than the threshold value; a second image generating 
step of generating a second image representing a view of the vehicle 
and the obstacle as seen from an area in the vicinity of the second 
viewpoint determined by the second viewpoint determination step; 

15 and a second display step of displaying the second image generated 
by the second image generating step. 

[0011] A third aspect of the present invention is directed 

to a computer program for causing a display device to selectively 
display at least two types of images in a vicinity of a vehicle. 

20 The computer program comprises a measurement step of measuring 
a distance and a direction from the vehicle to an obstacle in the 
vicinity of the vehicle; a comparison step of comparing the distance 
measured by the measurement section with a predetermined threshold 
value; a first viewpoint determination step of determining a 

25 predetermined first viewpoint when a result received from the 



comparison step indicates that the measured distance is larger 
than the threshold value; a first image generating step of 
generating a first image representing a view in the vicinity of 
the vehicle as seen from the first viewpoint determined by the 
5 first viewpoint determination step; a first display step of 
displaying the first image generated by the first image generating 
step; a second viewpoint determination step of determining a second 
viewpoint based on the distance measured by the measurement step 
when a result received from the comparison step indicates that 

10 the measured distance is not larger than the threshold value; a 
second image generating step of generating a second image 
representing a view of the vehicle and the obstacle as seen from 
an area in the vicinity of the second viewpoint determined by the 
second viewpoint determination step; and a second display step 

15 of displaying the second image generated by the second image 
generating step. 

[0012] In the respective aspects described above, the first 

viewpoint and the second viewpoint are represented by 
three-dimensional coordinate values, respectively, a horizontal 

20 direction component of the second viewpoint is larger than a 
horizontal direction component of the first viewpoint, and a 
vertical direction component of the second viewpoint is smaller 
than a vertical direction component of the first viewpoint. 
[0013] In the respective aspects described above, the 

25 three-dimensional coordinates of the first viewpoint are set at 



a point which is above the vehicle, and the three-dimensional 
coordinates of the second viewpoint are set at a point having a 
predetermined depression angle which is formed between the 
horizontal plane and a line extending from the second viewpoint 
5 in a direction of the vehicle and the obstacle. 

[0014] In the respective aspects described above, the second 

viewpoint is set at a point contained in a vertical plane orthogonal 
to a line between the vehicle and the obstacle. 
[0015] In the respective aspects described above, the 

10 vertical plane is a plane which perpendicularly bisects the line 
between the vehicle and the obstacle. 

[0016] In the respective aspects described above, whether 

the vehicle is capable of moving without contacting the obstacle 
is determined. When it is determined that the vehicle is capable 

15 of moving without contacting the obstacle, a display section 
displays a third image different from the second image. 
[0017] In one example, a height of the obstacle is measured, 

and whether the vehicle is capable of moving without contacting 
the obstacle is determined based on the measured height of the 

20 obstacle. 

[0018] In another example, a steering angle of the vehicle 

is detected, and whether the vehicle is capable of moving without 
contacting the obstacle is determined based on the detected 
steering angle of the vehicle. 
25 [0019] In the above example, when it is determined that the 



vehicle is capable of moving without contacting the obstacle, the 
second viewpoint is determined additionally based on the detected 
steering angle. In this case, the second viewpoint is preferably 
set at three-dimensional coordinate values such that a driver can 
5 visually recognize both the obstacle and a spot, on the vehicle, 
which contacts the obstacle. 

[0020] When a plurality of distances and directions of 

obstacles are measured, one distance and one direction, which are 
most likely to contact the vehicle, are preferably selected. In 

10 this case, the selected distance and direction are compared with 
predetermined threshold values. When a comparison result 
indicates that the measured distance is not larger than the 
threshold value, the second viewpoint is determined based on the 
selected direction . 

15 [0021] A plurality of active sensors are mounted at any of 

a front part, a rear part, a right side part or a left side part 
of the vehicle, whereby an obstacle in the vicinity of the vehicle 
is detected. 

20 EFFECT OF THE INVENTION 

[0022] According to the respective aspects described above, 

a distance and a direct ion from a vehicle to an obstacle are measured. 
When the measured distance is not larger than a predetermined 
threshold value, i.e., the vehicle and the obstacle are in close 

25 proximity to each other, the second image data representing a view 



of the vehicle and the obstacle as seen from an area in the vicinity 
of the second viewpoint determined based on the measured direction 
is generated and displayed. Since the second viewpoint is set 
as such, the obstacle is less likely to enter a dead zone generated 
5 by the vehicle in the second image data. Therefore, it becomes 
possible to provide a vehicle surrounding display device capable 
of displaying images such that the driver can more easily visually 
recognize an obstacle. 

[0023] These and other objects, features, aspects and 

10 advantages of the present invention will become more apparent from 
the following detailed description of the present invention when 
taken in conjunction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
15 [0024] [FIG. 1] FIG. 1 is a schematic diagram illustrating 

a block configuration of a vehicle surrounding display device 1 

according to an embodiment of the present invention. 

[FIG. 2] FIG. 2 is a schematic diagram illustrating 

exemplary arrangements of active sensors 111 included in a 
20 measurement section 11 shown in FIG. 1. 

[FIG. 3] FIG. 3 is a schematic diagram illustrating 

contents of data stored in a data accumulating section 16 shown 

in FIG. 1. 

[FIG. 4] FIG. 4 is a flowchart illustrating an 
25 operation of the vehicle surrounding display device 1 shown in 
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FIG. 1. 

[FIG. 5] FIG. 5 is a schematic diagram illustrating 
obstacles B existing in areas which are in front, rear or either 
side of a vehicle A shown in FIG. 1. 

[FIG. 6A] FIG. 6A is an enlarged view of the active 
sensors 111 and the obstacle B 2 , both shown in FIG. 2, as seen 
from thereabove. 

[FIG. 6B] FIG. 6B is an enlarged view of the active 
sensor 111 and the obstacle B 2 , both shown in FIG. 6A, as seen 
from a side thereof. 

[FIG. 7] FIG. 7 is a schematic diagram f or describing 
a method of deriving a distance C when an obstacle B exists in 
any of areas which are diagonally across the vehicle A shown in 
FIG. 1 from each other. 

[FIG. 8A] FIG. 8A is a schematic diagram of second 
viewpoints P 2 , determined by a viewpoint determination section 
13 shown in FIG. 1, seen from thereabove. 

[FIG. 8B] FIG. 8B is a schematic diagram of the 
second viewpoints P 2 , determined by the viewpoint determination 
section 13 shown in FIG. 1, viewed from therebehind. 

[FIG. 9] FIG. 9 is a schematic diagram of the second 
viewpoints P 2 , determined by the viewpoint determination section 
13 shown in FIG. 1, viewed from thereabove, when the obstacle B 
exists in any of the areas which are diagonally across the vehicle 
A shown in FIG. 1 from each other. 



[FIG. 10] FIG. 10 is a schematic diagram 

illustrating an image of a particular spot displayed in a display 
section 15 shown in FIG. 1. 

[FIG. 11] FIG. 11 is a schematic diagram 

5 illustrating a bird's eye image displayed in the display section 
15 shown in FIG. 1. 

[FIG. 12] FIG. 12 is schematic diagram illustrating 
a block configuration of a vehicle surrounding display device la 
according to a first variant of the present invention. 
10 [FIG. 13] FIG. 13 is a flowchart illustrating an 

operation of the vehicle surrounding display device la shown in 
FIG. 1. 

[FIG. 14] FIG. 14 is a schematic diagram 

illustrating a height H B derived by a contact determination section 
15 21 shown in FIG. 12. 

[FIG. 15] FIG. 15 is a schematic diagram 

illustrating a block configuration of a vehicle surrounding display 
device lb according to a second variant of the present invention. 

[FIG. 16] FIG. 16 is a flowchart illustrating an 
20 operation of the vehicle surrounding display device lb shown in 
FIG. 15. 

[FIG. 17A] FIG. 17A is a first schematic diagram 
illustrating a preferable second viewpoint P 2 determined by the 
viewpoint determination section 13 shown in FIG. 15. 
25 [FIG. 17B] FIG. 17B is a second schematic diagram 
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illustrating the preferable second viewpoint P 2 determined by the 
viewpoint determination section 13 shown in FIG. 15. 

[FIG. 18] FIG. 18 is a schematic diagram 

illustrating an outline process of a conventional vehicle 
5 surrounding display device. 



DESCRIPTION OF THE REFERENCE CHARACTERS 

[0025] 1, la, lb vehicle surrounding display device 

11 ••• measurement section 
10 12 ■•• comparison section 

13 •■• viewpoint determination section 

14 ■•■ image generating section 

15 ••• display section 

16 ••• data accumulating section 

15 21, 32 *•* contact determination section 

31 ••• steering angle sensor 

BEST MODE FOR CARRYING OUT THE INVENTION 
[0026] ( embodiment ) 

20 FIG. 1 is a schematic diagram illustrating an example 

of a block configuration of a vehicle surrounding display device 
1 according to an embodiment of the present invention. In FIG. 1, 
the vehicle surrounding display device 1 is mounted on a vehicle 
A. The vehicle surrounding display device 1 includes ameasurement 

25 section 11, a comparison section 12, a viewpoint determination 
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section 13, an image generating section 14, and a display section 
15. Preferably, the vehicle surrounding display device 1 also 
includes a data accumulating section 16. 

[0027] The measurement section llmeasures at least adistance 

5 C and a direction D from the vehicle A to an obstacle B in the 
vicinity of the vehicle. For such a measurement, in the present 
embodiment, as shown in FIG . 2, the measurement section 11 includes 
a plurality of active sensors 111 (16 such active sensors are 
illustrated in FIG. 2 ) . The active sensors 111 are typically laser 

10 radars, millimeter wave radars, or quasi-millimeter wave radars. 
Each of the active sensors 111 scans within a range of approximately 
plus minus 45 degrees horizontally, and scans within a range of 
approximately plus minus 20 degrees vertically, thereby detecting 
the obstacle B existing within a detected range of the sensor. 

15 As shown in FIG. 2, the vehicle A has four active sensors 111 
positioned in a front part, a rear part, a right side part and 
a left side part, respectively, such that the obstacle B within 
360 degrees of the vehicle A can be detected. 

[0028] The comparison section 12 compares the distance C 

20 measured by the measurement section 11 with a previously stored 
threshold value E, and generates a comparison result F. Note that 
the threshold value E is a reference value to determine whether 
the vehicle A comes in close proximity to the obstacle B. In the 
present embodiment, when the measured distance C is larger than 
25 the threshold value E, the comparison result F is W F T "; and when 
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the measured distance C is not larger than the threshold value 
E, the comparison result F is "F F " . 

[0029] When the comparison result F received from the 

comparison section 12 indicates "F T ", the viewpoint determination 
5 section 13 determines a first viewpoint Pi to allow a driver to 
see the vehicle A from above. On the other hand, when the received 
comparison result F indicates "F F ", the viewpoint determination 
section 13 determines, based on the direction D measured by the 
measurement section 11, a second viewpoint P 2 to allow the driver 

10 to visually recognize a particular spot on the vehicle A. 

[0030] When the image generating section 14 receives the first 

viewpoint Pi from the viewpoint determination section 13, the image 
generating section 14 generates first image data I a representing 
an environment in the vicinity of the vehicle A as seen from the 

15 first viewpoint P x . On the other hand, when the image generating 
section 14 receives the second viewpoint P 2 from the viewpoint 
determination section 13, the image generating section 14 generates 
second image data I b representing a spot, on the vehicle A, which 
is likely to contact the obstacle B as seen from the second viewpoint 

20 P 2 . 

[0031] The comparison section 12, viewpoint determination 

section 13 and image generating section 14 typically include a 
combination of a CPU, a ROM, and a RAM, and the processes performed 
by each section are realized by causing the CPU to execute a computer 
25 program stored in the ROM by means of the RAM. 
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[0032] When the display section 15 receives the first image 

data I a from the image generating section 14, the display section 
15 displays a bird' s eye image of the vehicle A based on the received 
data. On the other hand, when the display section 15 receives 
5 the second image data I b from the image generating section 14, 
the display section 15 displays an image of a particular spot on 
the vehicle A based on the received second image data I b . By such 
a display process, the bird's eye image of the vehicle A based 
on the first image data I a and the image of the particular spot 

10 on the vehicle A based on the second image data I b are provided 
to a driver of the vehicle A. For such a display process, the 
display section 15 is applicable to an on-vehicle navigation system, 
a monitor mounted with a television receiver, a head-up display, 
or a head-mounted display. 

15 [0033] The data accumulating section 16 typically includes 

an HDD (Hard Disc Drive), a DVD (Digital Versatile Disc), or a 
semiconductor memory. As shown in FIG. 3, the data accumulating 
section 16 stores a variety of data. Firstly, a height H A of the 
vehicle A (hereinafter, referred to as vehicle height data) , and 

20 object data M A representing an outer shape of the vehicle A are 
stored. In addition, the data accumulating section 16 also stores 
a width W A of the vehicle A (hereinafter, referred to as vehicle 
width data) , and an overall length L A of the vehicle A (hereinafter, 
referred to as vehicle length data) . 

25 [0034] Furthermore, the data accumulating section 16 stores 
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a mounting position P s of each active sensor 111. Each mounting 
position P s of the corresponding active sensor 111 is represented 
by a vertical distance from the ground, a distance from any of 
corners of the vehicle A, and the like. Still furthermore, the 
5 data accumulating section 16 also stores object dataM B representing 
an outer shape of an object such as a person, a wall or a tree, 
which may become an obstacle B. 

[0035] The variety of data stored in the aforementioned data 

accumulating section 16 is mainly used for generating the first 

10 image data I a and the second image data I b . 

[0036] Next, referring to a flowchart of FIG . 4, an operation 

of the vehicle surrounding display device 1 shown in FIG. 1 is 
described. When there is the obstacle B in the vicinity of the 
vehicle A, the measurement section 11 detects the obstacle B (step 

15 Sll) . Specifically, the measurement section 11 derives a distance 
C and a direction D from the vehicle A to the obstacle B. Furthermore, 
the measurement section 11 predicts what the currently detected 
obstacle B may be, thereby obtaining a predicted result G. 
[0037] Referring to FIGs . 5, 6A, and 6B, a method of deriving 

20 the distance C is described. FIG. 5 is a schematic diagram 
illustrating the obstacles B existing in areas which are in front, 
rear or either side of the vehicle A (shown hatched) . FIG. 5 
typically illustrates the vehicle A seen from above. FIG. 5 also 
exemplifies a case where there are an obstacle Bi in the left side 

25 of the vehicle A and an obstacle B 2 in the rear of the vehicle 



A. 

[0038] Each of the obstacles Bi and B 2 , and the active sensor 

111 (hereinafter , referred to as an adjacent active sensor) 
positioned closest to the obstacle have a positional relationship 
5 therebetween as shown in FIGs. 6A and 6B. FIG. 6A is an enlarged 
view of the adjacent active sensor 111 and the obstacle B x (or 
B 2 ) as seen from thereabove. FIG. 6B is an enlarged view of the 
active sensors 111 and the obstacle Bi (or B 2 ) , both shown in FIG. 6A, 
as seen from a side thereof. 

10 [0039] As shown in FIGs . 6Aand6B, the ad j acent active sensor 

111 detects a distance d, an azimuth angle 9 and an elevation angle 
cp, between the active sensor 111 and the obstacle Bi (or B 2 ) . In 
order to obtain a closest distance C between the adjacent active 
sensor 111 and the obstacle Bi (or B 2 ) , the measurement section 

15 11 substitutes the distance d, the azimuth angle 9 and the elevation 
angle cp into c= d- cos9 • coscp . The direction D toward the vehicle 
A is typically represented by both of the azimuth angle 9 and the 
elevation angle cp between the vehicle A and the adjacent active 
sensor 111. 

20 [0040] FIG. 7 is a schematic diagram for describing a method 

of deriving a distance C, when an obstacle B exists in any of areas 
which are diagonally across the vehicle A from each other (shown 
hatched) and no obstacle B exists in front, rear, and either side 
of the vehicle A. FIG. 7 typically illustrates the vehicle A and 

25 the obstacle B both seen from above. FIG. 7 also exemplifies a 
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case where there is the obstacle B in the right rear of the vehicle 
A. 

[0041] In the above case, an active sensor 111 in the left 

rear of the vehicle A is an adjacent active sensor 111. In this 
5 case, similarly to above, the adjacent active sensor 111 detects 
a distance d, an azimuth angle 8 and an elevation angle <p, between 
the active sensor 111 and the obstacle B. Therefore, a closest 
distance C and the azimuth angle cp are obtained by the measurement 
section 11 in a similar manner as described above. On the other 
10 hand, since the adjacent active sensor 111 is mounted diagonally 
rearward from the vehicle A, the azimuth angle 9 is converted into 
a direction D to the vehicle A by means of a mounting position 
of the adjacent active sensor 111 stored in the data accumulating 
section 16. 

15 [0042] Moreover, the obstacle B can be predicted, forexample, 

based on the intensity of reflected waves to that of outgoing waves 
of the active sensors 111, irrespective of an area in which the 
obstacle B exits. 

[0043] The distance C, the direction D and the predicted 

20 result G, which have been all obtained thereby, are stored in the 
RAM. 

[0044] Next, the comparison section 12 compares the distance 

C stored in the RAM with the threshold value E stored in the 
comparison section 12, and stores the comparison result F in the 
25 RAM (step S12) . Specifically, when the distance C is larger, the 
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comparison result "F T " is stored in the RAM; and when the distance 
C is not larger, the comparison result "F F " is stored in the RAM. 
As described above, the threshold value E is a reference value 
to determine whether the vehicle A comes in close proximity to 
5 the obstacle B. The threshold value El is selected, for example, 
at 1 meter. However, this value may be changed in accordance with 
a designation of a driver or a design specification of the vehicle 
surrounding display device 1. Based on such a threshold value 
E, the comparison result F indicates whether the obstacle B exists 

10 in the vicinity of the vehicle A. 

[0045] Next, the viewpoint determination section 13 

determines whether the comparison result F stored in the RAM is 
"F F " (step S13) . If it is determined Yes, it indicates that the 
vehicle A has already come in close proximity to the obstacle B. 

15 Thus, in this case, the viewpoint determination section 13 
determines the second viewpoint P 2 so as to show a particular spot 
(step S14) . 

[0046] Hereinafter, a detailed exemplary process performed 

in step S15 is described. Firstly, the viewpoint determination 

20 section 13 uses the direction D currently stored in the RAM to 
determine the second viewpoint P 2 . Therefore, the viewpoint 
determination section 13 can identify a direction of an area 
including the obstacle B as seen from the vehicle A. Furthermore, 
the second viewpoint P 2 is set at three-dimensional coordinate 

25 values obtained when depression angles R have predetermined values 



20 



(e.g. , 45 degrees) with respect to the horizontal plane, such that 
a spot in the vicinity of the adjacent sensor 111 (i.e., a spot 
on the vehicle A which is highly likely to contact the obstacle 
B) will appear as an image of a particular spot. The depression 
5 angle R is an angle between the horizontal plane and a line extending 
from the second viewpoint P 2 to the horizontal plane, and the line 
must extend in a direction of the adjacent active sensor 111 or 
its detecting range. A value of the depression angle R may be 
changed in accordance with a designation of a driver or a design 

10 specification of the vehicle surrounding display device 1. 

[0047] The viewpoint determination section 13 preferably 

uses, in addition to the direction D, the distance C currently 
stored in the RAM so as to determine the second viewpoint P 2 . In 
this case, as shown in FIGs. 8A and 8B, the second viewpoints P 2 

15 are respectively set at three-dimensional coordinate values 
contained in a vertical plane P v orthogonal to a line L s representing 
a shortest distance between the vehicle A and the obstacle B, the 
three-dimensional coordinate values obtained when depression 
angles R are predetermined values with respect to the horizontal 

20 plane. More preferably, the vertical plane P v is a plane which 
perpendicularly bisects the line L s . In FIG. 9, the respective 
second viewpoints P 2 are indicated when the obstacle B exists in 
any of areas which are diagonally across the vehicle A from each 
other (shown hatched) . 

25 [0048] The viewpoint determination section 13 passes the 
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second viewpoint P 2 set as described above to the image generating 
section 14. When receiving the second viewpoint P 2 , the image 
generating section 14 generates second image data I b (step S15) . 
Firstly, the object data M B representing the obstacle B and the 
5 object data M A representing the vehicle A, which have been both 
detected so as to correspond with the predicted result G stored 
in the data accumulating section 16, are retrieved. Next, the 
image generating section 14 places an object representing the 
obstacle B and an object representing the vehicle A in such a 

10 positional relationship as to contain the distance C and the 
direction D therebetween, both stored in the RAM. Thereafter, 
the image generating section 14 generates the second image data 
I b representing a view of the both objects as seen from the received 
second viewpoint P 2 . Preferably, a numerical value indicating 

15 the distance C between the obstacle B and the vehicle A, and a 
numerical value indicating a height H B of the obstacle are also 
incorporated into the second image data I b - 

[0049] The image generating section 14 forwards the second 

image data I b generated thereby to the display section 15. As 
20 shown in FIG. 10, the display section 15 displays an image of a 
particular spot based on the second image data I b (step S16) . 
Thereafter, a process returns to step Sll. 

[0050] If it is determined No in step S13, the viewpoint 

determination section 13 determines that the vehicle A has not 
25 yet come in close proximity to the obstacle B, and determines the 
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first viewpoint Pi (step S17) . 

[0051] In the present embodiment, the first viewpoint Pi is 

set above the vehicle A. Here, it is assumed that the first 
viewpoint Pi is denoted by three-dimensional coordinate values 
5 (0, 0, zi) , and the second viewpoint P 2 is denoted by 
three-dimensional coordinate values (x 2 , y 2 , z 2 ) , respectively. 
The second image data I b (i.e., the second viewpoint P 2 ) is required 
for a driver to more easily visually recognize a spot, on the vehicle 
A, which is likely to contact the obstacle B. Thus, from an origin 

10 point, a vertical direction component of the first viewpoint Pi 
(i.e., Izil) is set larger than a vertical direction component 
of the second viewpoint P 2 ( i . e . , I z 2 I ) . Furthermore, for the above 
requirement, the second viewpoint P 2 needs to be horizontally 
displaced from the first viewpoint P x . Therefore, from the origin 

15 point, a horizontal direction component of the first viewpoint 
Pi is set smaller than a horizontal direction component of the 
second viewpoint P 2 (i.e., V (x 2 2 +y 2 2 ) ) . 

[0052] The viewpoint determination section 13 passes the 

first viewpoint Pi set as described above to the image generating 

20 section 14. When receiving the first viewpoint Pi, the image 
generating section 14 generates first image data I a (step S18) . 
The first image data I a is generated in a similar manner to the 
second image data I b . However, a viewpoint for the first image 
data I a is different from that of the second image data I b . Similarly 

25 to the second image data I b , a numerical value indicating the 
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distance C between the vehicle A and the obstacle B, and a numerical 
value indicating a height H B of the obstacle B may be incorporated 
into the first image data I a . 

[0053] The image generating section 14 forwards the first 

5 image data I a generated thereby to the display section 15 . As shown 
in FIG . 11, the display section 15 displays a bird's eye image 
based on the first image data I a (step S19) . Thereafter, a process 
returns to step Sll. 

[0054] By the above process, when the obstacle B comes in 

10 close proximity to the vehicle A or the vehicle A comes in close 
proximity to the obstacle B, and the distance C between the vehicle 
A and the obstacle B is larger than the threshold value E, an bird 7 s 
eye image based on the first image data I a is displayed in the 
display section 15. Since the bird's eye image represents an 
15 environment in the vicinity of the vehicle A as seen above the 
vehicle A, a driver can substantially understand the situation 
in the vicinity of the vehicle. 

[0055] On the other hand, the distance C between the vehicle 

A and the obstacle B becomes not larger than the threshold value 

20 E, an image of a particular spot based on the second image data 
I b is displayed in the display section 15. The second viewpoint 
P2, which has been set based on the detected direction D of the 
obstacle B, is used for generating the image of the particular 
spot. The image of the particular spot represents an enlarged 

25 view of a spot, on the vehicle A, in the vicinity of the adjacent 



active sensor 111 which has detected the obstacle B, whereby the 
obstacle B will be less likely to enter a dead zone. As a result, 
the driver can more easily visually recognize a spot, on the vehicle 
A, which may be highly likely to contact the obstacle B. 
5 [0056] Furthermore, by using not only the direction D but 

also the distance C for the second viewpoint P 2 , it becomes possible 
to generate the second image data I b representing the image of 
the particular spot such that the driver can more easily visually 
recognize a positional relationship between the vehicle A and the 
10 obstacle B. 

[0057] Specifically, as shown in FIGs . 8A, 8B, and 9, the 

second viewpoint P 2 is preferably set at three-dimensional 
coordinate values contained in a vertical plane P v orthogonal to 
a line L s representing a shortest distance between the vehicle 

15 A and the obstacle B, the three-dimensional coordinate values 
obtained when a depression angle R is a predetermined value with 
respect to the horizontal plane. More preferably, the vertical 
plane P v is a plane which perpendicularly bisects the line L s . The 
second viewpoint P 2 is set in such a manner as described above, 

20 whereby both of the adjacent active sensor 111 and the obstacle 
B are likely to appear as the image of the particular spot. Thus, 
it becomes possible to provide a vehicle surrounding display device 
capable of displaying an image of a particular spot such that a 
driver can more easily visually recognize a positional relationship 

25 between the vehicle A and the obstacle B. Moreover, indicating 
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the distance C in the display section 15 allows the driver to 
understand the positional relationship between the vehicle A and 
the obstacle B more easily. 

[0058] The above embodiment illustrates an example where the 

5 first image data I a and the second image data I b are both generated 
on the basis of the object data M A stored in the data accumulating 
section 16, and if necessary, the object data M B is also used for 
generating the data . However, the present invention is not limited 
thereto. The data similar to the first image data I a or the second 
10 image data I b may be generated by means of images imaged by imaging 
devices mounted at a front part, a rear part or either side part 
of the vehicle A, respectively. 

[0059] There may be a case where the measurement section 11 

detects a plurality of obstacles B. In such a case, the 

15 aforementioned process is preferably applied to one of the 
obstacles B, which exists in the traveling direction of the vehicle 
A and which is closest to the vehicle A. 
[0060] (first variant) 

FIG. 12 is a schematic diagram illustrating an example 

20 of a block configuration of the vehicle surrounding display device 
1 according to a first variant (hereinafter, referred to as a vehicle 
surrounding display device la) of the present invention. In 
FIG. 12, the vehicle surrounding display device la is different 
from the vehicle surrounding display device 1 shown in FIG. 1 in 

25 that the vehicle surrounding display device la further includes 
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a contact determination section 21 . There are no other differences 
between the vehicle surrounding display devices 1 and la. 
Therefore, in FIG. 12, like elements corresponding to those of 
FIG. 1 are denotedby like reference numerals, and the descriptions 
5 thereof are omitted. 

[0061] The contact determination section 21 derives a height 

H B from the ground to the bottom of the obstacle B, and compares 
the height H B with a height H A of the vehicle A (hereinafter, referred 
to as vehicle height data) stored in the data accumulating section 

10 16 to be described below. Then, the contact determination section 
21 determines whether the vehicle A can pass under the obstacle 
B, and generates a determination result J. In the present 
embodiment, when the height H B is larger than the vehicle height 
data H A , the contact determination section 16 determines that the 

15 vehicle A can pass through . In this case, the determination result 
J is "J T ". On the other hand, when the height H B is not larger 
than the vehicle height data H A , the determination result J is 

[0062] The above contact determination section 16 also 

20 typically includes a combination of the CPU, the ROM, and the RAM. 
[0063] Next, referring to a flowchart of FIG . 13, anoperation 

of the vehicle surrounding display device la shown in FIG. 12 is 
described. The flowchart shown in FIG. 13 is different from that 
of FIG. 4 in that the flowchart shown in FIG. 13 further includes 
25 step S21 and step S22. There are no other differences between 



the two flowcharts. Therefore, in FIG. 13, like steps 
corresponding to those of FIG. 4 are denoted by like reference 
numerals, and the descriptions thereof are omitted. 
[0064] After step Sll, the contact determination section 21 

5 derives the height H B from the ground to the bottom of the obstacle 
B shown in FIG. 14. The height H B is obtained by substituting a 
distance C and an elevation angle cp, which are both currently stored 
in the RAM, and a height h of an adjacent active sensor 111 (included 
in mounting position data) into H B =h+D- sincp . Thereafter, the 

10 contact determination section 16 compares the currently derived 
height H B with the height data H A of the vehicle A stored in the 
data accumulating section 16. When the height H B is larger, the 
contact determination section 16 determines that the vehicle A 
can pass under the obstacle B, and stores "J T " in the RAM as the 

15 determination result J. On the other hand, when the height H B 
is not larger, " J F " is stored in the RAM as the determination result 
J (step S21) . 

[0065] After step S21, the viewpoint determination section 

13 determines whether the determination result J stored in the 

20 RAM is "J F " (step S22) . If it is determined Yes, it indicates 
that the vehicle A cannot pass under the obstacle B. Thus, the 
viewpoint determination section 13 performs the aforementioned 
steps from step S12 onward, in order to determine whether an image 
of a particular spot should be generated. On the other hand, if 

25 it is determined No in step S22, it indicates that the vehicle 
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A can pass under the obstacle B . Thus, the viewpoint determination 
section 13 performs the aforementioned steps from step S17 onward. 
[0066] The aforementioned determination is performed based 

on a height such that a driver can use the vehicle surrounding 
5 display device la in a situation, for example, where a vehicle 
is parked into a parking space, thus making it possible to provide 
the vehicle surrounding display device la having better usability. 
[0067] In the present variant, a height H B from the ground 

to the bottom of the obstacle B may also be incorporated into an 

10 image of a particular spot. 
[0068] (second variant) 

FIG . 15 is a schematic diagram illustrating an example 
of a block configuration of the vehicle surrounding display device 
1 according to a second variant (hereinafter, referred to as a 

15 vehicle surrounding display device lb) of the present invention. 
In FIG. 15, the vehicle surrounding display device lb is different 
from the vehicle surrounding display device 1 shown in FIG. 1 in 
that the vehicle surrounding display device lb further includes 
a steering angle sensor 31 and a contact determination section 

20 32 . There are no other differences between the vehicle surrounding 
display devices 1 and lb. Therefore, in FIG. 15, like elements 
corresponding to those of FIG. 1 are denoted by like reference 
numerals, and the descriptions thereof are omitted. 
[0069] The steering angle sensor 31 detects a steering angle 

25 of the vehicle A, and passes a detected result to the contact 
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determination section 32. 

[0070] The contact determination section 32 derives a 

predicted trajectory through which the vehicle A is intended to 
move based on the detected result outputted from the steering angle 
5 sensor 31. Furthermore, the contact determination section 32 
determines whether an obstacle B exists along the derived predicted 
trajectory based on a distance C and direction D, both stored in 
the RAM, between the vehicle A and the obstacle B. Thereafter, 
the contact determination section 32 generates a determination 

10 result K. In the present embodiment, when the obstacle B exists 
along the predicted trajectory, the contact determination section 
32 stores "K T " in the RAM as the determination result J; and when 
no obstacle B exists along the predicted trajectory, "K T " is stored 
in the RAM as the . determination result K. 

15 [0071] The above contact determination section 32 also 

typically includes a combination of the CPU, the ROM, and the RAM. 
[0072] Next, referring to a flowchart of FIG . 16, an operation 

of the vehicle surrounding display device lb shown in FIG. 15 is 
described. The flowchart shown in FIG. 16 is different from that 

20 of FIG. 4 in that the flowchart shown in FIG. 16 further includes 
step S31 and step S32. There are no other differences between 
the two flowcharts. Therefore, in FIG. 16, like steps 
corresponding to those of FIG. 4 are denoted by like reference 
numerals, and the descriptions thereof are omitted. 

25 [0073] After step Sll, the contact determination section 32 
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derives the predicted trajectory of the vehicle A by means of a 
detected result outputted from the steering angle sensor 31. 
Furthermore, the contact determination section 32 determines 
whether the obstacle B exists along the derived predicted 
5 trajectory, and stores the determination result K ("K T " or "K F ") 
in the RAM (step S31) . 

[0074] After step S31, the viewpoint determination section 

13 determines whether the determination result K stored in the 
RAM is "K F " (step S32). If it is determined Yes, it indicates 

10 that the obstacle B and the vehicle A are not likely to contact 
each other. Thus, the viewpoint determination section 13 performs 
the aforementioned steps from step S17 onward. On the other hand, 
if it is determined No in step S32, it indicates that the obstacle 
B and the vehicle A are likely to contact each other. Thus, the 

15 viewpoint determination section 13 performs the aforementioned 
steps from step S12 onward, in order to determine whether an image 
of a particular spot should be generated. 

[0075] The aforementioned determination is performed based 

on whether a contact is likely to occur such that a driver can 
20 use the vehicle surrounding display device lb in a situation, for 
example, where a vehicle is parked into a parking space, thus making 
it possible to provide the vehicle surrounding display device la 
having better usability. 

[0076] In the present variant, the predicted trajectory may 

25 also be incorporated into an image of a particular spot or a bird' s 
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eye image. 

[0077] In the aforementioned embodiment , as shown in FIGs . 8A , 

8B, and 9, the second viewpoints P 2 are set at two points. Even 
if either point is set as the second viewpoint P 2 , the same effects 
5 can be obtained. In the present variant, however, the second 
viewpoint P 2 is preferably set as described below. That is, for 
example, as shown in FIG. 17A, when the obstacle B exists in the 
rear of the vehicle A which is moving backward, and a steering 
wheelof the vehicle A is turned to the left side (counterclockwise) , 
10 a point on the right side of the vehicle A is to be set as the 
second viewpoint P 2 . 

[0078] Alternatively, as shown in FIG . 17B, when the obstacle 

B exists on the left side of the vehicle A which is moving forward, 
and the steering wheel of the vehicle A is turned to the left side, 
15 a point on the left side of the vehicle A is to be set as the second 
viewpoint P 2 . 

[0079] Thus, a second viewpoint P 2 is set in accordance with 

a direction of the obstacle B from the vehicle A, a traveling 
direction of the vehicle A, and an operating direction of a steering 
20 wheel. The second viewpoint P 2 is set in such a manner, thereby 
allowing the display section 15 to display how the vehicle A comes 
in proximity to the obstacle B. Thus, a driver can easily 
understand a positional relationship between the vehicle A and 
the obstacle B. 

25 [008 0] The above first and second variants may be incorporated 
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together into the vehicle surrounding display device 1 according 
to the embodiments above. 

[0081] While the invention has been described in detail, the 

foregoing description is in all aspects illustrative and not 
5 restrictive. It is understood that numerous other modifications 
and variations can be devised without departing from the scope 
of the invention. 

INDUSTRIAL APPLICABILITY 
10 [0082] A vehicle surrounding display device according to the 
present invention is applicable to a navigation device, a parking 
assist device or the like, which is required to display images 
such that a driver can more easily visually recognize an obstacle. 



